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Method and Device for linking Multimedia Data 



The present invention relates to a method and device for 
linking first and second multimedia data. Particularly, 
these first and second multimedia data include a video 
stream and photo pictures. 

Background 

Many digital camcorders _gan record video films on a tape and 
photo pictures (or E-video clips) on a media-card. The image 
contents taken in videos and photos are usually very corre- 
lated and coherent. For example, video and photos might be 
related in the following aspects: taken in the same time; 
taken at the same place; shot to same objects (persons); 
shot in a similar scene; taken during the same event; taken 
under the same mood or feeling; photo and video are content- 
compensated; photos represent the highlight still contents 
of a video etc. Many kinds of new camcorders can even record 
e-video clips on a media card. Such e-video clips represent 
the highlight of a video. E-video clip is very a kind of 
video thumbnail . 

However, the video films on the tape and the photos (or E- 
video clips) on the media-card are treated separately by ed- 
iting and archiving. Such a procedure is illustrated in Fig. 
1. A digital camcorder 100 is used for recording 101 a video 
sequence on a camcorder~mini-tape 103.~ At a later time the 
video film is played back and edited 103 using a video re- 
corder and a television set 104 or a personal computer 105. 
Alternatively, the camcorder 100 may record 106 a photo on a 
camcorder media-card 107. After recording the photo may be 
viewed and edited 108 by using a personal computer 105. 
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While recording, hd connection (or relation) is defined for 
the recording contents between video and photo (or e-video 
clip) . Today, editing and customizing the relation between 
recordings on the tape and the media card requires an edit- 
ing process separate from the act of recording itself, and 
this process is also performed on an equipment different 
from the recording equipment* However, it is impossible for 
a camera-man while recording to make use of still pictures 
(or e-video clips) in a media-card in order to set up more 
attractive features for the video contents on a tape. 

Invention 



In view of that it is the object of the present invention to 
provide a method and an apparatus which allows linking of 
two or more different multimedia data. 

This object is solved by a method for linking multimedia 
data including the steps of providing first and second mul- 
timedia data, forming linking information on the basis of 
said first and/or second multimedia data, and storing said 
linking "information on a first recording medium together 
with said first multimedia data. 

Furthermore, according to the present invention there is 
provided a device for recording multimedia data including 
providing means for providing first and second multimedia 
data, linking means connected to said providing means for 
forming linking information on the basis of said first 
and/or second multimedia data, and storing means connected 
to said linking means for storing said linking information 
on a first recording medium together with said first multi- 
media data. 

Preferably, the first and second multimedia data include 
video, photo and/or audio data. Thus, it is possible to mu- 
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tually link a video film or video sequences with photo pic- 
tures . 

The linking information may include logo or index messages 
5 for the video film, the photo pictures and/or any audio se- 
quences. Such logo message contains linking information from 
a video on the tape to a picture on the media card. The in- 
dex message contains one or more codes of related pictures 
on the current media card. With such logo or index messages 

10 it is possible to link photo data and video data for example 
on the basis of a photo picture included in these photo data 
or by a video section included in this video data. One can 
easily imagine that a characterizing photo picture facili- 
tates the linkage of a plurality of pictures and video films 

15 for the user. 

Advantageously, the linking information may be formed in 
real-time while recording the video on the video tape. Thus, 
both is possible, the offline editing of logo and index pic- 
20 tures as well as the real time generation of them. 

Logo and index messages^tnay be set up and recorded both on a 
video tape and on a picture media- card. This technique has 
the advantages of making an easy and fast recording opera - 
25 tion possible, of helping the user to do post -editing and of 
preventing the user from accidently deleting any useful pic- 
tures on the multimedia-card. 

The pictures may be designed as "logo and index", "logo 
30 only" and "index only". Furthermore, some strategies for re- 
cording and playback may be designed as "visible" and "in- 
visible", "copy now" and "copy later", "playback with logo" 
and "playback without logo". Additionally, an e-video-clip 
may be used as logo or index message. Thus, the present in- 
35 vent ion helps to set up a significant "bridge" between video 
essence and photo essence seperately recorded by a digital 
camcorder . 
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The logo and index pictures (metadata) are usually not gen- 
erated directly from video frames- They are usually gener- 
ated by photo shooting before the recording of video con- 
tents . 

In other words, the Easy Video Logo & Index Picture Genera- 
tion System according to the present invention for a Camcor 
der makes it possible to let the camera-man to set up logo 
or index pictures (or video clip) for video while recording 
While a logo or index picture is being created, a logo-mark 
code is written to a special track on video tape, or a in- 
dex-mark code is written to a special index file in the me- 
dia-card. The logo pictures (or video clips) can improve a 
kind of "picture in picture" function. The logo picture pro 
vides additional messages to the recording video, and there 
fore it makes the recording more attractive. The index pic- 
ture acts as a kind of rich media metadata for the video es 
sence. It can be utilized to search video essence. 

Drawings 

Exemplary embodiments of the invention are illustrated in 
the drawings and are explained in more detail in the follow- 
ing description. In the drawings: 

Fig. 1 shows the procedure of taking videos and photos by a 
digital camcorder of the prior art; 

Pig. 2 shows the principle of taking videos and photos by a 
digital camcorder according to the present invention; 

Fig. 3 shows the physical order of a video tape containing a 
logo track; 
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Fig, 4 shows a first part of the logical structure of a me- 
dia card; 

Fig. 5. shows a second part of the logical structure of a 
5 media card; 

Fig. 6 shows a diagram of the system requirements; 

Fig. 7 shows a diagram of the recording procedures of logo 
10 and index pictures; 

Fig. 8 shows a diagram of the logo fixing during video play- 
back; 

is Fig. 9 shows a first continuation of figure 8; 

Fig. 10 shows a second continuation of figure 8; 

Fig. 11 shows a diagram for the procedure of index fixing. 

20 

Exemplary embodiments 

The principle of taking videos and photos by a digital cam- 
corder according to the present invention is shown in Fig. 

25 2. Similar to the prior art, a camcorder 200 records 201 a 
video on a mini -tape 202. The recorded video may be played 
back and edited 203 by using a video recorder and a televi- 
son set 204 or a personal computer 205. Additionally, the 
camcorder 200 may record "206 phdtos on a media card 207. The 

30 recorded photos may be viewed and edited 208 by using the 

personal computer 205. Now, the following steps are provided 
by the present invention. A relation may be created 209 be- 
tween the video and photo data. Information concerning the 
relation to the photos is written 210 as logo- info (see also 

35 step 302 of Fig. 6) to the tape 202. Similarly information 

concerning the relation to the video recorded on the tape is 
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written 211 as index-info (see also step 4 05 of Fig. 6) to 
the media-card 207. Consequently, the video may be searched, 
played and edited 212 on the personal computer 205 by using 
the logo-info. Additionally, a photo may be searched, played 
and edited 212 on the personal computer 2 05 by using the' in- 
dex-info. 

The preferred system and its implementation components are 
described in the following, wherein the description for 
"logo /index picture" is also valid for "logo /index e-video 
clip" . 

1. System Requirements 500 (see Pig. 6) 

a) It is necessary to equip a camcorder with a set of but- 
tons 501, which allow to put the camcorder in a special 
"mark input mode". In the basic embodiment, a camcorder has 
an annotation button in a central and easy to reach posi- 
tion. In an enhanced type of camcorder there may be provided 
an E-video clip playback function. In order to create a logo 
/ index picture for video, special memory space on a video 
tape and on a media-card must be reserved? ' " 

b) For the video tape 300 (compare also Fig. 3) , a special 
logo track 302 (or logo bytes) for each video frame must be 
reserved on the tape for recording the logo-mark code 303. 
The logo-mark code 303 contains link messages from the video 
on the tape to a picture on the media-card. The logo-mark 
code 303 contains a media- card ID 304 and a picture ID mes- 
sage 305. The media-card ID message 304 is a kind of volume 
ID, it may be a predefined media-card name or number. The 
picture ID includes the picture name message. 

Fig. 3 indicates the physical structure of a video tape 300. 
The video tape 3 00 contains a plurality of video frames 301 
each formed by a number of data bits. Within the video frame 
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3 01 there is provided a logo track 302 for the logo-info, 
i.e. the logo marke code 303, containing a media-card ID 3 04 
and a picture ID 305. Thus, there is a link to a logo pic- 
ture on a specific media card. 

c) For media-card 400 (compare also Fig. 4 and 5), the index 
info 405 including a special index file 420, a special tem- 
porary file 410 and a special thumbnail directory 43 0 must 
be generated in* the media-card. The index file 420 in the 
media -card 400 is created for a recording index-mark code 
421. The temporary file 410 is used to keep temporary index 
code 411 for logo/ index picture candidates. The thumbnail 
directory 430 is set to store all thumbnail pictures 431, 
which may be used as logo or index pictures (see Fig- 4 and 
6) . 

d) The index file 42 0 in the media- card 400 contains index- 
mark codes 421 of all related pictures in the current media- 
card as shown in Fig. 6. Whenever a picture is set as logo 
or index to the video, an index-mark code 421 will be cre- 
ated in the index file 420. The index-mark code 421 includes 
all link messages between pictures on the media-card 400 and 
video essence on the tape 300 • There are two kinds of index- 
mark codes 421 : 

When a picture is set as index picture 422 for video, the 
index-mark code 421 includes a picture ID 424 and video es- 
sence ID message 423. The picture ID 424 contains a picture 
name 427, directory name 428 and status label 429 of the re- 
lated picture. The status label shows if the picture is 
"logo & index" , "logo only" or * index only" . More about 
status label will be explained in detail in 2 (h) and 3 (c to 

e) . The video essence ID 423 contains video tape ID 425, 
video content start-time and end-time message 426. The video 
tape ID 425 may be a predefined tape name or number. 

When a picture is only set as logo picture 412 for video, 
the index-mark code 421 contains only the picture ID 424. In 
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this case, no video essence ID 423 is needed. See also Fig. 
5. 

e) The temporary file 410 shown in Fig. 5 contains index 
s codes of all candidate pictures in the current media-card 

400. When a picture is selected as candidate to create video 
logo or index, an index code (compare 411 of Fig. 6) will be 
written in the temporary file 410. The index code includes a 
picture ID message 424, the picture ID contains picture name 
10 427, directory name 42 8 and status label 429 of the selected 
picture. While video recording, camera-man may select pre- 
defined logo or index candidate directly from the candidate 
file. 

15 f) The thumbnail directory 43 0 shown in Fig. 4 contains all 
thumbnail pictures, which are used as logo / index pictures 
for video. Compared to an original picture, a thumbnail pic- 
ture is reduced in size so that it needs less storage capac- 
ity. The thumbnail directory 430 has the advantage of pro- 

20 tecting thumbnail pictures so that they are not affected by 
normal photo editing. 

g) A special synchronizing playback method is needed to 
build e-video clip logo in video frames as indicated by ref- 
25 erence signs 502 in Fig. 6. In this case, an e-video clip 
can be treated as a series of still pictures. Each picture 
may be built in video frame one by one. 

2, Preparation for Recording 

30 

a) In order to create logo & index pictures for a video 
while recording, a selected picture, which will be used as 
logo or index picture, should be recorded before the video 
is recorded. The picture may be taken by camcorder itself, 
35 or imported from other instruments. The picture may be saved 
as normal camcorder photo format, or as special thumbnail 
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format. The thumbnail format is defined specially for this 
application. A thumbnail picture will be saved directly in 
the thumbnail directory 430 of media-card 400 (see Fig. 4) . 
Both photo formatted picture and thumbnail picture can be 
5 selected as logo / index picture. 

In the case of Fig. 4 pictures 1, 3 and 6 are stored as 
thumbnail pictures with a reduced size in the thumbnail di- 
10 rectory 43 0. Consequently , the pictures 1, 3 and 6 can be 
deleted from the picture directories 440 and 450. As a re- 
sult memory capacity can be saved. 

b) The index screen of the camcorder may be used to select a 
15 preferred picture. The picture name 427, directory name 428 

of the selected picture and a status label 429 (see 2 (g) ) is 
encoded as an index code 421, which is saved in the tempo- 
rary file 410 in the media-card 400. A selected picture can 
be input into the temporary file 410 by clicking a button of 
20 the camcorder- It is also possible to select the picture 

during video recording by inputting the picture index number 
directly. 

c) All selected pictures must be set to "protected" status, 
25 so that they cannot be deleted erroneously. 

d) More than one picture can be selected as logo / index 
candidates picture to be stored in the temporary file. While 
video recording, all candidate pictures can be browsed 

30 through button wheel turning. 

e) The logo picture format and position on the video can be 
defined before, during or after recording. The logo picture 
can be shrunk or enlarged inside the video frame. Further- 

35 more, the logo picture may be located at the upper, under, 
left or right corner. It may fill up the whole video frame. 
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f ) The logo picture may be processed according to a prede- 
fined effect function. 

g) The selected picture can be defined in three statuses: 

5 "logo Sc index", w logo only" and "index only". A status la- 
bel, which represents the status message, is created as part 
of the index code in the temporary file. The "logo & index" 
status means that the selected picture is defined both as 
logo and index picture for video. The "logo only" status 

10 means that the selected picture is defined only as logo pic- 
ture for video, it is impossible to use this picture as in- 
dex metadata for video essence. The "index only" status 
means that the selected picture is defined only as index 
metadata for video essence, it is impossible to use it as 

15 logo picture for video. The default status of a selected 
picture should be defined as "logo & index" . 

h) The temporary file (see 1 (e) ) contains index codes of all 
logo / index candidate pictures. The index code includes 

20 picture name, picture directory name and picture status la- 
bel. The status label can represent "logo & Index" , "logo 
only" ~ and "index only" . The temporary file should be created 
before video recording. The index codes in the candidate 
file will be cleared as soon as they are invalid. 

25 

i) A selected picture can be used multiple as logo / index 
picture . 

30 3. Recording 600 (see Fig. 7) 

a) While video recording, the camera-man only needs to click 
601 a button to browse all selected pictures from the candi- 
date file in the media-card. Through button clicking 601, 
35 the camera-man can set a selected picture as logo or index 
picture for video. If no pre- selected picture exists in the 
candidate file, the camera-man only needs to click a button 
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to browse a list of all pictures of. the media-card, and turn 
a wheel to select a picture and set the picture as logo or 
index picture for video. For a selected picture the statuses 
"logo-only" 602, "logo & index" 603 and "index only" 604 may 
5 be chosen. 

b) If a selected picture is set to be logo picture of video 
605, the logo picture may be set to be visible 606 or in- 
visible 607 in the camcorder view finder. 

10 (1) When it is visible 606, its position and frame size 

may be adjusted by camera-man. The camera-man may choose 
whether to "copy now'' 608 to the video tape or "copy later" 
609. If "copy now" 608 is selected, the logo picture with 
its position and size in the view finder will be embedded in 

15 the video contents and be permanently recorded on the video 
tape. Later the logo picture in the video can not be edited 
or deleted any more. In this case, it is not necessary to 
create any logo mark on the tape or index-mark in the media 
card 610. If "copy later" 609 is selected, the logo picture 

20 is not recorded on the video tape, the picture stays still 
in the media card. It is still possible to edit the logo 
picture later at a post -processing stage. In this case, both 
logo-mark and index-mark are generated 611. The logo-mark 
code is written in the logo track on the tape, and the in- 

25 dex-mark code, which contains only picture ID, is written in 
the index file in the media- card. The selected picture must 
be set to "protected" . 

(2) When the logo picture is set to be invisible 607, the 
logo picture is not recorded on the video tape, and the logo 

30 picture will be edited at post -processing stage. In this 

case, both logo-mark and index-mark are generated 611. The 
logo-mark code is written in the logo track on the tape, and 
the index-mark code, which contains only the picture ID, is 
written in the index file in the media-card- The selected 

35 picture must be set to "protected" . 
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c) if a selected picture is in "logo & index" status 603, it 
means that this picture will be set up as both logo and in- 
dex picture for video. In this case, both logo-mark and in- 
dex-mark are generated 611. The logo-mark code is written in 
5 the logo track on the tape, and the index-mark code, which 
contains the picture ID and video essence ID, is written in 
the index file in the media-card. The logo-mark code and in- 
dex-mark code are structured as described in paragraph 1 . 

10 When a selected picture is set as logo and index picture for 
video, it should be set to "protected" . 

In this scenario, the logo picture can be treated as de- 
scribed in 2 (e) . 



15 d) If a selected picture is in "logo only" status 602, this 
picture will be created as logo picture for video. 

In case, the logo picture is set as "visible" + "copy 
now" 606,608, the logo picture is recorded on the tape, no 
logo -mark or index-mark code is generated in this scenario, 

20 the related picture in media-card does not need to be set 
protected, and editing of this picture does not affect the 
already created log picture. 

In case, the logo picture is set "invisible" 607 or 
"visible" + "copy later" 606, 60 9, both logo-mark and index - 

25 mark must be generated. The logo mark code is written in 

logo track (or logo bits) on the video tape- The index-mark 
code, which contains only the picture ID, is written in the 
index file of the media-card. 

30 e) If a selected picture is in "index only" status 604, this 
picture will be created as index picture for video 612 . 
Later, this picture acts as rich media metadata for video 
essence. In this case, only an index-mark is generated 613, 
no logo-mark is necessary. The index-mark code, which con- 

35 tains both picture ID and video essence ID, is written in 

index file in media-card. The selected picture in the media- 
card must be set to "protected" . 
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4. Logo Fixing 700 (see Pig. 8, 9 and 10) 

a) At a post -processing stage, except the case of 3 (b-1) , 
all in the recording stage generated logo pictures need to 

5 be edited or fixed, 

b) The logo-mark codes can connect video essences and logo 
pictures. While video playing, the camcorder can automati- 
cally read the logo-mark code from a logo track on a tape. 

10 

c) When the user plays or edits the video tape, he may 
choose "playback with logo" 701 or "playback without logo" 
702 . 

When "playback without logo" is chosen the camcorder will 
15 play the video tape normally, logo-marks on video tape are 
ignored 706. 

When "playback with logo" 701 is chosen, the camcorder 
reads all logo-marks. When the camcorder finds a new logo- 
mark, it will pause the tape playback at the current video 

20 frame, and ask the user whether to build the logo picture in 
the video frame or not. If the user replies "not built-in", 
the camcorder goes on playing the tape till next new logo- 
mark. If the user replies "built-in", the camcorder will 
parse the logo-mark code, tell the user to insert the cor- 

25 rect media-card, read the index file of the media-card, find 
out the directory of the logo picture, look for the logo 
picture on the media-card and build the picture in the video 
frame. The position and size of the logo picture viewed in 
the video frame can be arranged and adjusted. The same logo 

30 picture at the same position and with the same size will be 
built in the following video frames, which contain the same 
logo-mark code. When the camcorder reads a new logo-mark 
code, it will repeat the above procedure. 



35 d) When "playback with logo" 701 is chosen, the user may 
have three choices to process the logo picture: 
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1) The user may record the logo picture permanently 703 
in the video frame at the desired position with the desired 
size as shown in Pig. 9, Afterwards, the camcorder will 
check the index file and find out if this picture is still 

5 locked by other index mark. 

If the picture is not locked by another index mark 707 
and it has "logo only" status 708 in the current index mark, 
the "protected" status of the picture will be cleared 709. 
Its index mark in index file will be cleared too. From now 
10 on, the connection between this picture and video is cut . 
The picture is free. 

If the picture is not locked by another index mark 707 
and it has "logo & index" status 710 in the current index 
mark, the "protected" status of this picture will not be 
15 cleared, but its status label in the current index mark will 
be modified as "index only" 711. From now on, this picture 
will act as pure index picture. 

If the picture is locked by another index mark 712 and it 
has "logo only" status 713 in the current index mark, the 
20 protected mark of the picture will not be cleared 714. But, 
the current index mark in index file will be cleared. 

If the picture is locked by another index* mark 712 and it 
has "logo & index" status 715 in current index mark, the 
"protected" status of this picture will not be cleared, but 
25 its status label in the current index mark will be modified 
as "index only" 716. From now on, this picture will act as 
index picture for the current video clip. 

2) The user does not want to record the logo picture in 
30 the video frame at present 704. The user, however, may let 

the camcorder generate a thumbnail picture based on the logo 
picture 704, as shown in Fig. 10. The thumbnail picture will 
replace the original logo picture and act as logo picture 
for video 717. The thumbnail picture only needs less storage 
35 space, and the original logo picture will be free from cur- 
rent connection. The thumbnail picture will be saved in the 



PD020062-R1-280602 

# • 

thumbnail directory (see l.(c) and (f))in the media-card 
with the same file name as the original logo picture. Later, 
the thumbnail picture will be used as the only logo picture 
for video, 

5 If the original logo picture is not locked by other index 

mark 719 and it has "logo only" status 720 in the current 
index mark, the "protected" status of the picture will be 
cleared 721, its directory name in current index mark will 
be modified to the name of the thumbnail directory. The 
10 thumbnail directory name in current index mark will auto- 
matically lead the camcorder to read the thumbnail picture 
in thumbnail directory as the logo picture. The connection 
between original logo picture and video is cut. The original 
picture is free. 

15 If the original logo picture is not locked by other index 

mark 719 and it has "logo & index" status 722 in current in- 
dex mark, the "protected" status of the picture will be 
cleared 723 . Its directory name in the current index mark 
will be modified to that of the thumbnail directory. The 

20 thumbnail picture in the thumbnail directory will act as new 
logo & index picture for video. The connection between 
original logo & index picture and video is cut. The original 
picture is free. 

If the original logo picture is locked by another index 

25 mark 724 and it has "logo only" status 725 in current index 
mark, the "protected" status of the picture will not be 
cleared 726, its directory name in current index mark will 
be modified to the thumbnail directory. This thumbnail di- 
rectory in the current "index mark will automatically lead 

30 the camcorder to read the thumbnail picture in thumbnail di- 
rectory as the logo picture. The connection between original 
logo picture and current video clip is cut. 

If the original logo picture is locked by another index 
mark and it has "logo & index" status 727 in current index 

35 mark, the "protected" status of the picture will not be 

cleared 728. Its directory name in current index mark will 
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be modified to the thumbnail directory. The thumbnail pic- 
ture in the thumbnail directory will act as new logo & index 
picture for video. The connection between original logo & 
index picture and current video clip is cut. 

5 

3) The logo picture will not be recorded to video frame 
705 at this moment. Nothing changes 729. 

e) The user can simply replace the original logo picture by 
10 another picture, by exchanging their file names (and modify- 
ing the directory name in index-mark code, if they are not 
located in the same directory) . 

f ) When the video on tape is cleared, the camcorder will 

15 promote the user to insert the related media-card, and clear 
all related index marks from the index file in the media- 
card, and clear the "protected" status of all related pic- 
tures . 

20 

5. Index Fixing 800 (see Fig. 11) 

a) Index-mark codes can link index pictures to video es- 
sences. The user can use an index picture to search video 
25 essences. Furthermore, the user can use an index picture to 
summary video contents, which are linked to the same index 
picture- The camcorder can automatically read index-mark 
codes in an index file of a media-card. 

30 b) The user can play video essences through "clicking" an 
index picture. Furthermore, the user can use index pictures 
to edit video contents. 

c) The user may use the original picture as index picture 
35 801 so that no further actions is necessary 802, and the 
user may also generate a thumbnail picture based on the 
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original one and use the thumbnail picture as new index pic- 
ture 803. The thumbnail picture is saved in the thumbnail 
directory and it has the same name as that of the original 
picture . 

5 If the picture is not locked by another index mark 804 

and it has " index only" status 805 in current index mark, 
the "protected" status of the picture will be cleared 806. 
The directory name in current index mark will be modified to 
the thumbnail directory name. The connection between the 
10 original picture and video essence is cut. The original pic- 
ture is free. 

If the picture is not locked by another index mark 804 
and it has "logo & index" status 807 in the current index 
mark, the user can choose between "thumbnail as logo too" 

15 808 and "thumbnail not as logo" 809: 

When user chooses "thumbnail as logo too" 808, the "pro- 
tected" status of the picture will be cleared 810. The di- 
rectory name in current index mark will be modified to that 
of the thumbnail directory name. The connection between the 

20 original picture and video essence is cut. The original pic- 
ture is free. The thumbnail acts as both logo and index pic- 
ture . 

When the user chooses "thumbnail not as logo" 809, the 
"protected" status of the original picture will not be 

25 cleared, but its status label in the current index mark will 
be modified as "logo only" 811. Prom now on, this picture 
will act as pure logo picture. In this scenario, a new index 
mark with "index only" status label, which points to the 
same video essence as that of the original index picture, 

30 must be created for the thumbnail picture, so that the user 
can use the thumbnail as index picture. 

If the picture is locked by another index mark 812 and it 
has "index only" status 813 in current index mark, the "pro- 
tected" mark of the picture will not be cleared 814. The di- 

35 rectory name in the current index mark will be modified to 
the thumbnail directory name. The connection between the 
original picture and current video essence is cut. 
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If the picture is locked by another " index mark 812 and it 
has "logo & index' 7 status 815 in current index mark, the 
"protected" status of this picture will not be cleared. In 
this case, the user may choose between "thumbnail as logo 
too" 816 and "thumbnail not as logo" 817: When user chooses 
"thumbnail as logo too" 816, the directory name in the cur- 
rent index mark will be modified to the thumbnail directory 
name. The connection between the original picture and cur- 
rent video essence is cut 818. When the user chooses "thumb- 
nail not as logo" 817, the status label in the current index 
mark will be modified as "logo only" 819. Prom now on, this 
picture will act as pure logo picture. In this scenario, a 
new index mark with "index only" status, which points to the 
same video essence as that of the original index picture, 
must be created for the thumbnail picture, so that the user 
can use it as index picture. 

6. Application Examples 
Scenario 1 : 

While camera-man is shooting a video scene or object, he 
is used to explain something about the scene or object. His 
voice will be recorded with the video content together. In 
this case, the camera-man can only be heard, not be seen. 
Usually, it is desired to hear his voice and see his face at 
the same time, just like that in TV-news program, while 
talking to a journalist through phone call, a photo of the 
journalist will be shown as logo picture in the display. 
With the help of this invention, the camera-man makes him- 
self to be visible in video scene too. At first, the camera- 
man takes a photo or an e-video clip of himself. Then, while 
video recording, he set this photo or e-video clip as logo 
picture to the video content- 
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Scenario 2 : 

Usually, photos and e -video clips are highlight contents 
of videos. They can be used as logo labels to summary video 
contents, or provide additional visual messages to video 
5 contents. For example, one may take a photo of Eiffel-Tower 
and use this photo as logo image for all video contents, 
which are recorded in Paris, or using Brandenburger - Tor as 
logo for all video taken in Berlin. If an e -video clip is 
created as logo to video, it provides a kind of simulated 
10 "picture in picture" effect. 



Scenario 3 : 

By using recorded index pictures, the camera-man can 
search video contents quickly and effectively. They can help 
15 the user to edit videos efficiently. 

Scenario 4 : 

By using this invention, one can generate rich media 
metadata for video essence. Such rich metadata will be used 
20 widely in the future. 
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Claims 



1. Method for linking multimedia data including the steps 
of 

5 

providing first and second multimedia data, wherein said 
first and second multimedia data comprise video, photo 
and/or audio data; 

10 forming linking information (209) on the basis of said 

first and/or second multimedia data; and 

storing said linking information (210) on a first re- 
cording medium (202) together with said first multimedia 
15 data (201) . 

2. Method according to claim 1, wherein said linking infor- 
mation includes logo (302) or index messages (405) for 
video or photo data, respectively. 

20 

3. Method according to claim 1 or 2, wherein said photo 
data and said video data are linked by a photo picture 
included in said photo data and/or a video section in- 
cluded in said video data. 

25 

4. Method according to one of the claims 1 to 3, wherein 
said" forming (209) of linking information is performed 
in real time while data recording. 

30 5. Method according to one of the claims 1 to 4, wherein 

said forming of linking information includes editing of 
said linking information. 



6. 

35 



Method according to one of the claims 1 to 5, further 
including the step of storing said linking information 
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(211) on a second recording medium (207) together with 
said second multimedia data (206) . 

7. Method according to one of the claims 1 to 6, wherein 
said first recording medium (202) and/or said second re- 
cording medium (207) is a tape, optical disc, hard disc 
or media-card. 

8. Device for recording multimedia data including 

providing means for providing first and second multime- 
dia data, wherein said first and second multimedia data 
comprise video, photo and/or audio data; 

linking means connected too said providing means for 
forming linking information (209) on the basis of said 
first and/or second multimedia data; and 

storing means connected to said linking means for stor- 
ing said linking information (210) on a first recording 
medium (202) together with said first multimedia data 
(201) . 

9. Device according to claim 8, wherein said linking infor- 
mation includes logo (302) or index messages (405) for 
video or photo data, respectively. 

10. Device according to claim 8 or 9, wherein said photo 

data and said video data are linked by a photo picture 
included in said photo data and/or a video section in- 
cluded in said video data. 

11. Device according to one of the claims 8 to 10, wherein 
said forming (209) of linking information by said link- 
ing means is performable in real time while data re- 
cording. 
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12. Device according to one of the claims 8 to 11, wherein 
said linking means includes editing means for editing 
said linking information. 

13. Device according to one of the claims 8 to 12, further 
including additional storing means for storing said 
linking information (211) on a second recording medium 
(207) together with said second multimedia data (206) . 

14. Device according to one of the claims 8 to 13, wherein 
said first recording medium (202) and/or said second re- 
cording medium (207) is a tape, optical disc, hard disc 
or media-card. 



15. Camcorder (20 0) including a device according to one of 
the claims 9 to 14. 
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Abstract 



Method and Device for linking Multimedia Data 



5 It is desired to link photo data and video data taken by a 
digital camcorder (200) . Therefore, there is provided a de- 
vice and method for linking multimedia data, wherein linking 
information is formed (209) on the basis of first and/or 
second multimedia data. The linking information is stored 

10 (210) on a recording medium (202) together with the first 
multimedia data (201) . The second multimedia data may be 
stored (206) together with respective linking information 
(211) to the first multimedia data on a second recording me- 
dium (207) . Thus, a camera-man while recording is able to 

is set up logo or index pictures for a video film. 



(Figure 2) 
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